• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    ABSTRACT The present invention relates to a device (100) and method for performing Fourier transform on a three dimensional data set. The device comprises a first one dimensional Fourier transform unit (110) arranged to receive the three dimensional data set as one dimensional data blocks related to a first spatial dimension and to perform a Fourier transform for the first spatial dimension based on the samples of the respective data blocks related to the first spatial dimension, a first data permutation unit (120) arranged to receive an output from the first one dimensional Fourier transform unit (110) and to provide the three dimensional data set as one dimensional data blocks related to a second spatial dimension, a second one dimension Fourier transform unit (130) arranged to receive the one dimensional data blocks related to the second spatial dimension and to perform a Fourier transform for the second spatial dimension based on the samples of the respective data blocks related to the second spatial dimension, a second data permutation unit (140) arranged to receive an output from the second one dimensional Fourier transform unit (130) and to provide the three dimensional data set as one dimensional data blocks related to a third spatial dimension , and a third one dimension Fourier transform unit (150) arranged to receive the one dimensional data blocks related to the third spatial dimension and to perform a Fourier transform for the third spatial dimension based on the samples of the respective data blocks related to the third spatial dimension. The first or second data permutation unit (120, 140) is arranged to associate a delay to each received sample determined so as to reorder read-out of the samples to provide the one dimensional data blocks related to the second or third spatial dimension.
    公开号:SE1450880A1
    申请号:SE1450880
    申请日:2014-07-09
    公开日:2016-01-10
    发明作者:Mario Garrido Galvez；Andreas Öhlin
    申请人:
    IPC主号:
    专利说明:

    ABSTRACT The present invention relates to a device (100) and method for performing Fourier transform on a three dimensional data set. The device comprises a first one dimensional Fourier transform unit (110) arranged to receive the three dimensional data set as one dimensional 5 data blocks related to a first spatial dimension and to perform a Fourier transform for the first spatial dimension based on the samples of the respective data blocks related to the first spatial dimension, a first data permutation unit (120) arranged to receive an output from the first one dimensional Fourier transform unit (110) and to provide the three dimensional data set as one dimensional data blocks related to a second spatial dimension, a second one 10 dimension Fourier transform unit (130) arranged to receive the one dimensional data blocks related to the second spatial dimension and to perform a Fourier transform for the second spatial dimension based on the samples of the respective data blocks related to the second spatial dimension, a second data permutation unit (140) arranged to receive an output from the second one dimensional Fourier transform unit (130) and to provide the three dimensional 15 data set as one dimensional data blocks related to a third spatial dimension , and a third one dimension Fourier transform unit (150) arranged to receive the one dimensional data blocks related to the third spatial dimension and to perform a Fourier transform for the third spatial dimension based on the samples of the respective data blocks related to the third spatial dimension. The first or second data permutation unit (120, 140) is arranged to associate a 20 delay to each received sample determined so as to reorder read-out of the samples to provide the one dimensional data blocks related to the second or third spatial dimension.
    For publication: figure 1 1 Device and method for performing a Fourier transform on a three dimensional data set TECHNICAL FIELD The present invention relates to a device and method for performing a Fourier transform on a 5 three dimensional data set.
    BACKGROUND The three dimensional Fast Fourier Transform (3D FFT) is often calculated one dimension at a time. This is realized by applying three 1D FFTs, one in each dimension.
    The problem when performing a 3D FFT in an environment which provides and demands a 10 fixed number of samples per time unit at the input and output respectively is the data management involved when performing the data permutations required to constantly provide correct order of input samples to the different 1D FFT blocks.
    Mario Garrido. "Efficient Hardware Architectures for the Computation of the FFT and other related Signal Processing Algorithms in Real Time." PhD thesis, Universidad Politecnica de Madrid, Spain, 2009 describes an existing design wherein 2D FFT is performed in that the first permutation which takes place between the first FFT and the second FFT is a simple matrix transposition, that is, the rows and columns of a two dimensional matrix are changing place. This is a well-studied problem that often occurs in mathematics, and hardware that performs 20 this permutation efficiently has been designed.
    Also S. Lan gemeyer, P. Pirsch, and H. Blume. "Using SDRAMs for two-dimensional accesses of long 2n x 2m -point FFTs and transposing.", In Proc. Int. Embedded Computer Systems (SAMOS) Conf, pages 242-248, 2011 describes an existing design 2D FFT is performed in that the first 25 permutation which takes place between the first FFT and the second FFT is a simple matrix transposition, that is, the rows and columns of a two dimensional matrix are changing place.
    Existing 3D FFT designs store three dimensional data on a memory and perform the required operations on data fetched iteratively from the memory, i.e. the algorithm is calculated by 2 reading some data from the memory, process these data and writing back the result to the memory. This is done iteratively until all calculations of the algorithm have been carried out. This means that all or almost all data have to be available before calculation can start and that no or almost no results are provided before being finished. This implies that there will be a 5 delay while the memory is filled with input samples. Further, it will be necessary to read from and write to the same memory locations various times which increases the amount of memory accesses. Further, there will also be a delay while the memory is emptied before next calculation can be started. The memory bottleneck of loading and unloading data to and from the same memory can be reduced by double buffering, which means that two memories are 10 used instead of one in order to increase the memory throughput. It will then be possible to access the two memories simultaneously so that the calculations can be performed using one memory while from the other the previous result is unloaded and later filled up with new data to be calculated. However, this solution almost doubles the amount of resources since these memories form a major part of the design. In addition, this iterative approach is suitable for 15 processing data that arrives in bursts, but is not suitable for processing a continuous flow of data.
    Chi-Li Yu, K. lrick, C. Chakrabarti and V. Narayanan. "Multidimensional OFT IP generator for FPGA platforms." 58(4):75-764, 2011 describes an existing 3D FFT design which stores three 20 dimensional data on a memory and carries out the required operations on data fetched iteratively from the memory as described above.
    U. Nidhi, Kolin Paul, Ahmed Hemani and Ansul Kumar. "High performance 3D-FFT implementation." 2013 describes a way of partially tackling this problem when computing on a 25 supercomputer or a network of processing elements. The solution is to load the data onto local memories of the different processing elements and to carry out the permutation between the first and second FFTs locally. Then, the permutation between the second and third FFTs is performed with the aid of an interconnection network, wherein the permutation between the second and third FFTs is performed by sending data back and forth between the 30 different processing elements. This solution is suitable when all data are available at start of calculation. If it is to be applied to real time processing the input data are first buffered and loaded onto the processing elements and then the next input data are buffered while 3 performing all calculations. This approach requires one full size memory and a number of smaller memories since all processing elements need to store a portion of the data locally. Further, the throughput (samples per time unit) is very limited since all processing elements have to finish before the next FFT calculation can be started and also the result has to be 5 unloaded from all the processing elements putting tough constraints for high throughput on the interconnection network.
    Further, in handling large amounts of data, an external memory would typically be used. In an application as described herein, the memory would in many cases have the size of hundreds of 10 megabytes. To enable high throughput, a fast memory would be desirable. These two requirements of a both large and fast memory lead in the contemporary available architectures to the use of dynamic memories. However, this class of memories has to be managed in a correct way in order not to lose data, and they typically present constraints on how to access the data stored in them. Existing designs propose solutions for handling these 15 constraints for matrix transposition but this problem has not been addressed for general permutations and permutations of more than two dimensions yet.
    SUMMARY One object of the present invention is to improve the way of determining a Fourier transform. 20 This has in one embodiment been solved by means of a device for performing Fourier transform on a three dimensional data set. The device comprises a first one dimensional Fourier transform unit, a first data permutation unit, a second one dimensional Fourier transform unit, a second data permutation unit, and a third one dimensional Fourier transform unit.
    The first one dimensional Fourier transform unit is arranged to receive the three dimensional data set as one dimensional data blocks related to a first spatial dimension and to perform a Fourier transform for the first spatial dimension based on the samples of the respective data blocks related to the first spatial dimension. The first data permutation unit is arranged to 30 receive an output from the first one dimensional Fourier transform unit and to provide the 4 three dimensional data set as one dimensional data blocks related to a second spatial dimension. The second one dimension Fourier transform unit is arranged to receive the one dimensional data blocks related to the second spatial dimension and to perform a Fourier transform for the second spatial dimension based on the samples of the respective data blocks 5 related to the second spatial dimension. The second data permutation unit is arranged to receive an output from the second one dimensional Fourier transform unit and to provide the three dimensional data set as one dimensional data blocks related to a third spatial dimension. The third one dimension Fourier transform unit is arranged to receive the one dimensional data blocks related to the third spatial dimension and to perform a Fourier 10 transform for the third spatial dimension based on the samples of the respective data blocks related to the third spatial dimension.
    The first or second data permutation unit is arranged to associate a delay to each received sample determined so as to reorder read-out of the samples to provide the one dimensional data blocks related to the second or third spatial dimension.
    The device is in one example used for calculating a 3D FFT. Each of the spatial dimensions of the three dimensional data set corresponds to one of the dimensions of the 3D FFT.
    The device is in one example used for calculating a 2D FFT. In accordance with this example, two of the spatial dimensions of the three dimensional data set correspond to one of the 20 dimensions of the 2D FFT and the other spatial dimension of the three dimensional data set corresponds to the other dimension of the 2D FFT. Therefore, the two dimensions of the 2D FFT are interpreted as a three dimensional space.
    The device is in one example used for calculating a 1D FFT. In accordance with this example, all 25 three spatial dimensions of the three dimensional data set correspond to the one dimension of the 1D FFT. Therefore, the one dimension of the 1D FFT is interpreted as a three dimensional space.
    The Fourier transform is for example a Fast Fourier Transform, FFT.
    This permutation of the first or second permutation unit can in one example be visualized as rotating the three axes, so that if the order of the axis before the permutation was Y,X,Z, after 5 the permutation the order will be Z,Y,X. This problem has been solved for a continuous flow of samples.
    The presented solution is based on pipelined calculation which continuously calculates the result. This makes it suitable for real time calculation since it can support continuous flow and 10 the results do not need to be loaded to a memory before a new calculation can be carried out.
    The provided solution is very resource effective. The design can easily be fitted together with other algorithms on the same FPGA or integrated circuit. 15 As a continuous flow is maintained through all the processing elements in the circuit, there are always resources to calculate all three dimensions at all times. This is in contrast to known prior art systems which performs 3D FFT on a distributed system where calculations are performed in parallel on different processing elements, where all processing elements are involved in each dimension, preventing continuous flow. This difference is fundamental and present in all designs based on parallelization of the calculation of each dimension onto all processing elements in the design, which is the case for most (if not all) designs aimed for such networks of processing elements including supercomputers.
    In one option, the first or second data permutation unit is arranged to reorder the samples so 25 as to perform a three dimensional rotation.
    This permutation of the first or second permutation unit can in one example be visualized as rotating the three axes, so that if the order of the axis before the permutation was Y,X,Z, after the permutation the order will be Z,Y,X. This problem has been solved for a continuous flow of 30 samples. 6 In one option, each sample of the three dimensional data set is associated to an index indicating its spatial position in the three dimensional data set and that the delay for the respective sample is determined in accordance with said index.
    In one option, the first and/or second data permutation unit comprises at least one memory 5 870. The memory is for example a random access memory or a set of them, a dynamic memory or a set of them, a set of registers, etc.
    In one option, the first or second permutation unit further comprises a controller arranged to control read-out from and writing to the at least one memory so that read-out of a sample from the memory and writing of a received sample is performed to the same memory position 10 in the memory.
    The memory bottleneck of loading and unloading data to and from the same memory has been avoided by this solution by always reading and writing to the same location in the memory.
    In one option, the controller further comprises a counter arranged to count a predetermined 15 number of clock cycles determined based on the number of spatial positions in the three dimensional data set and wherein the controller is arranged to control writing to and read-out from the memory based on a counter signal from the counter. In a case wherein several inputs are handled in parallel, the number of clock cycles is also determined based on the number of samples handled in parallel.
    In one option, the controller further comprises an address mapper unit arranged to receive the counter signal from the counter and to map the received counter signal to an associated memory position in the memory for reading and writing a sample.
    In one option, the address mapping unit comprises a plurality of selectable mapping schemes 25 and wherein the controller further comprises a mapping selector unit arranged to select one mapping scheme from the plurality of mapping schemes based on the counter signal and to provide a select signal indicating the selected mapping scheme. 7 In one option, the controller further comprises a multiplexer arranged to receive the select signal from the mapping selector unit and to control output from the address mapper unit in accordance with the received select signal.
    In one option, the first or second permutation unit further comprises an auxiliary permutation 5 unit arranged to re-order samples read out from the at least one memory so as to permute locked bits in the memory.
    One advantage with this solution is that the device can be used together with dynamic memories typically presenting constraints on how to access the data stored in them as the solution performs the required three dimensional permutation between the second 1D FFT 10 and the third 1D FFT, (Fig. la) or between the first 1D FFT and the second 1D FFT (Fig. lb) in such a way that it is both made sure the permutation is correct and that the memory timings and regulations are taken into account and fulfilled.
    In one option, the device is arranged to handle parallel inputs.
    In one option, the device is arranged to perform three dimensional Fourier transform on the tree dimensional data set.
    In one option, the device is arranged to perform Fourier transform on a cubic three dimensional data set. 20 In one option, the device is arranged to perform three dimensional Fourier transform on the cubic three dimensional data set.
    One embodiment of the disclosure relates to a method for performing Fourier transform on a three dimensional data set. The method comprises the steps of receiving the three dimensional data set as one dimensional data blocks related to a first 25 spatial dimension performing a Fourier transform for the first spatial dimension based on the respective data blocks so as to provide the three dimensional data set Fourier transformed in the first dimension, 8 providing the three dimensional data set as one dimensional data blocks related to a second spatial dimension, performing a Fourier transform for the second spatial dimension based on the respective data blocks so as to provide the three dimensional data set Fourier transformed in the first and 5 second dimensions, providing the three dimensional data set as one dimensional data blocks related to a third spatial dimension, and performing a Fourier transform for the third spatial dimension based on the respective data blocks so as to provide the three dimensional data set Fourier transformed in the first, second 10 and third spatial dimensions.
    The step of providing the three dimensional data set as one dimensional data blocks related to a second or third spatial dimension comprises associating a delay to each received sample according to a permutation scheme, wherein the permutation scheme is determined so as to reorder the samples to provide the one dimensional data blocks related to the second or third spatial dimension.
    In one option, the step of providing three dimensional data set as one dimensional data blocks related to a second or third spatial dimension comprises a step of controlling read-out from and writing to at least one memory so that read-out of a sample from the memory and writing of a received sample is performed to the same memory position in the memory. 20 In one option, the step of providing three dimensional data set as one dimensional data blocks related to a second or third spatial dimension comprises a step of providing a counter signal counting a predetermined number of clock cycles determined based on the number of spatial positions in the three dimensional data set, wherein writing to and read-out from the memory is controlled based on the counter signal. 25 In one option, the step of providing the three dimensional data set as one dimensional data blocks related to a second or third spatial dimension comprises a step of mapping the received counter signal to an associated memory position in the memory for reading and writing a sample. 9 One embodiment of the disclosure relates to software for executing the steps of the method for performing Fourier transform on a three dimensional data set in accordance with the above. 5 BRIEF DESCRIPTION OF THE DRAWINGS Figs la, lb, lc and ld show an overview of devices for performing a Fast Fourier Transform.
    Fig 2 illustrates schematically an example of a three dimensional data set for transformation in device of Fig 1.
    Fig 3 shows an example of a first FFT unit in a device of Fig 1. 10 Fig 4 shows an example of a first permutation unit in a device of Fig 1.
    Fig 5 shows an example of a second FFT unit in a device of Fig 1.
    Fig 6 shows an example of a second permutation unit in a device of Fig 1.
    Fig 7 shows an example of a third FFT unit in a device of Fig 1.
    Fig 8 shows detailed example of a second permutation unit in form of a 3D rotation unit. 15 Fig 9 illustrates schematically the operation of a second permutation unit in form of a 3D rotation unit without memory constraints.
    Fig 10 illustrates schematically an example of an operation on the respective samples of a three dimensional data set in a second permutation unit in form of a 3D rotation unit without memory constraints. 20 Fig 11 illustrates schematically an example of an operation on the respective samples of a three dimensional data set in a second permutation unit in form of a 3D rotation unit with memory constraints.
    Fig 12 is a flow chart illustrating a method for performing Fourier transform on a three dimensional data set. 10 Fig 13 is a flow chart illustrating one example of a step in the method for performing a permutation with a memory.
    Figs 14a. 14b and 14c illustrate schematically examples of different formats for the data set for input to a Fourier transform device.
    DETAILED DESCRIPTION Figures la and lb relate to three dimensional Fast Fourier Transform,3D FFT, devices 100a, 100b arranged to calculate the three dimensional Fast Fourier Transform, 3D FFT, on a three dimensional data set, one dimension at a time. This is realized by applying three 1D FFTs, one 10 in each dimension, and providing the correct sequence of input data to the respective 1D FFT so that the calculations are performed in the correct order.
    The exemplified system of Fig la and lb aims for continuous flow applications. 15 In the 3D FFT of Fig la, all rows are translated to columns in a 2D permutation between the first and the second FFT. In one example, the 2D permutation translates X, V. Z to Y, X, Z. Further, all three dimensions are rotated between the second FFT and the third FFT. This permutation can be visualized as rotating the three axes, so that if the order of the axis before the permutation was Y,X,Z, after the permutation the order will be Z,Y,X.
    In the 3D FFT of Fig lb, all three dimensions are rotated between the first FFT and the second FFT. This permutation can be visualized as rotating the three axes, so that if the order of the axis before the permutation was X,Y,Z, after the permutation the order will be Y,Z,X which is a rotation in the opposite direction compared to Fig la. Further, all rows are translated to 25 columns in a 2D permutation between the second and the third FFT. In one example, the 2D permutation translates Y,Z,X to Z,Y,X.
    The input to the system may be continuous flow serial input data from real time applications such as e.g. motion detection in sequences of images or Synthetic Aperture Radar (SAR). The 30 input to the system may also be data related to fluid dynamics, astrophysics, gene sequencing 11 and molecular dynamics. The system can also be used as an accelerator for ordinary PCs that are performing 3D FFT. The dataset may be very large. The input may be configured in many ways. For example, it may have a single input where data come in series or several parallel inputs. In both cases data arrives in a continuous flow, i.e., the system receives one sample 5 per clock cycle at each of the inputs.
    In the example of Figs la and b, the three dimensional fast Fourier transform system 100a and 100b comprises a first 1D Fourier transform determination unit 110, a first permutation unit 120, 140, a second 1D Fourier transform unit 130, a second permutation unit 140, 120 and a 10 third 1D Fourier transform determination unit 150.
    In one example, the first permutation unit 120 is a 2D translation unit and the second permutation unit is a 3D rotation unit 140. In one alternative example, the first permutation unit 140 is a 3D rotation unit and the second permutation unit is a 2D translation unit 120.
    In the following description, reference is made to the example wherein the first permutation unit 120 is a 2D translation unit and the second permutation unit is a 3D rotation unit 140.
    The first one dimensional Fourier transform (determination) unit 110 is arranged to receive 20 the three dimensional data set as one dimensional data blocks related to a first spatial dimension. The first 1D Fourier transform (determination) unit 110 is arranged to perform Fourier transform for the first spatial dimension based on the respective data blocks and to provide the three dimensional data set Fourier transformed in the first spatial dimension. The output from the first 1D Fourier transform unit 110 is fed to the first permutation unit 120.
    The first permutation unit 120 is arranged to receive the three dimensional data set Fourier transformed in the first spatial dimension as one dimensional data blocks related to the first spatial dimension and to provide the received three dimensional data set as one dimensional data blocks related to a second spatial dimension.
    The second one dimensional Fourier transform (determination) unit 130 is arranged to receive the three dimensional data set as one dimensional data blocks related to the second spatial 12 dimension. The second 1D Fourier transform (determination) unit 130 is arranged to perform Fourier transform for the second spatial dimension based on the respective data blocks and to provide the three dimensional data set Fourier transformed in the second and first spatial dimension. The output from the second 1D Fourier transform unit 130 is fed to the second 5 permutation unit 140.
    The two dimensional and three dimensional permutations performed by the permutation units 120, 140 of the system are adapted to the configuration of the input data. Further, the first and second 120, 140 permutation units may be connected differently in the system if the 10 1D FFT units are adapted accordingly. Each block may then have a single input where data come in series or several parallel inputs. In both cases data arrives in a continuous flow, i.e., the system receives one sample per clock cycle at each of the inputs.
    The first permutation unit 120 is arranged to operate in cooperation with one or a plurality of 15 memories 160.
    The second data permutation unit 140 is arranged to receive the three dimensional data set Fourier transformed in the second spatial dimension as one dimensional data blocks related to the second spatial dimension and provide the three dimensional data set as one dimensional data blocks related to a third spatial dimension. This will be discussed in detail later. The second data permutation unit is arranged to operate in cooperation with one or a plurality of memories 170.
    The third one dimensional Fourier transform (determination) unit 150 is arranged to receive 25 the three dimensional data set as one dimensional data blocks related to the second spatial dimension. The third 1D Fourier transform unit 150 is arranged to perform Fourier transform for the third spatial dimension based on the respective data blocks and to provide the three dimensional data set Fourier transformed in the third, second and first spatial dimension. 13 Thus, a 3D FFT is provided by the first 1D Fourier transform unit 110, the first permutation unit 120, the second 1D Fourier transformation unit 130, the second permutation unit 140 and the third 1D Fourier transform unit 150.
    The operation for computation of the three dimensional Fourier transform is in one example 5 as follows. The formula of a 3D FFT for an input signal x[rh, n2] is: j2rcn2k2 j2rcn3k3 X[ki, k2, k3] =x[ni, n2, n3]e.1 eN2 eN3 /27 n1,0 n2=0 n3=0 where N1 is the number of rows of the matrix, N2 is the number of columns, and N3 is the number of heights. The equation is defined for k1 = 0, 1, ..., N1-1, k2 = 0, 1, ..., N2-1 and k3 = 0, 1, ..., N3-1. 10 The 3D FFT can be performed as an FFT of each row of the matrix followed by an FFT of each column and followed by an FFT of each height, which can be observed by rewriting equation above as: N1-1 N2-1 N3-1 N3 -1 7N2 -1 7Ni -1 -j21cn2 k2 X[ki, k2, k3] =[Illy n2, n3] ee-j27 N2 n3=0 i0 ni=0 n3k3 -j2rc e, Therefore, it is possible to use three pipelined 1D FFT units for the computation of the 3D FFT 15 in real time. One of them calculates the FFT of the rows, other one obtains the FFT of the columns and the third one calculates the FFT of the heights. Common FFTs can be used as the 1D-FFTs for the computations of the respective blocks. In addition to this, two permutation modules are required. The first receives in one example the data row by row from the first FFT and provides them column by column, as required for the second FFT. This is equivalent to 20 transposing the data matrix after the first FFT. The second permutation module receives data column by column and provides data height by height by performing the rotation as discussed herein.
    In Fig 2 an example of the format of an input data set is illustrated. In the illustrated example 25 each input data set comprises a 3D structure. The input data set forms a three dimensional 14 matrix, wherein each position in the matrix is associated with a value. The number of samples in each spatial direction is in one example a power of two.
    In one example, the samples of data are input row-wise (herein shown as the x-dimension) for 5 each layer in the third dimension (herein shown as the z-dimension). The index information related to the position of the respective sample in the data set is not required as an input. In one example, starting information to start the computations can be provided before start of input of the data set or it can be provided in relation to each block. 10 Figs 14a, 14b and 14c illustrate different examples of data sets for input to a device for performing Fourier transform on the data set. In Fig 14a, the data set is a three dimensional data set having a first Ni, a second N2 and a third N3 spatial dimension. In Fig 14b, the three dimensional data set has a first Ni, a second N2 and a third N3 spatial dimension, wherein the first and the second spatial dimensions correspond to one of the dimensions of a 2D FFT. In Fig 15 14c, the data three dimensional data set has a first Ni, a second N2 and a third N3 spatial dimension, wherein the first, second and third spatial dimensions all correspond to the same dimension of a 1D FFT.
    Figures lc and ld relate to Fast Fourier Transform FFT devices 100c and 100d arranged to 20 calculate the Fast Fourier Transform on a three dimensional data set, one dimension at a time. The calculation of the Fast Fourier transform is as described in relation to Figures la and lb realized by applying three 1D FFTs, one in each dimension, and providing the correct sequence of input data to the respective 1D FFT so that the calculations are performed in the correct order. In the same manner as the exemplified system of Fig la and lb, the exemplified system 25 of Fig lc and lc aims for continuous flow applications.
    The Fast Fourier Transform device 100c of Fig lc has the same parts as the Fast Fourier Transform device of Fig la or Fig lb. In order perform 1D FFT and/or 2D FFT, the Fast Transform Fourier device 100c of Fig lc is complemented with one or two rotation units 180a, 180b. The respective rotation unit 180a, 180b is in one example arranged to calculate the 30 twiddle factors of the FFT. In a case wherein the Fast Fourier Transform device is arranged to calculate a 2D FFT, the Fast Fourier Transform device has one of a first rotation unit 180a and a second rotation unit 180b. The first rotation unit 180a, if present, is arranged between the first FFT unit 110 and the second FFT unit 130. The second rotation unit 180b, if present, is arranged between the second FFT unit 130 and the third FFT unit 150. In a case wherein the Fast Fourier Transform device is arranged to calculate a 1D FFT, the Fast Fourier Transform device has both the first rotation unit 180a and the second rotation unit 180b. The first 5 rotation unit 180a is arranged between the first FFT unit 110 and the second FFT unit 130. The second rotation unit 180b is arranged between the second FFT unit 130 and the third FFT unit 150. In the illustrated example of Fig lc, the first rotation unit 180a is arranged in the flow directly after the first FFT unit 110 and fed with the data from the first FFT unit 110. In the illustrative example of Fig lc, the second rotation unit 180b is arranged in the flow directly 10 after the second FFT unit 130 and fed with the data from the second FFT unit 130.
    The Fast Fourier Transform device 100d of Fig ld has the same parts as the Fast Fourier Transform device of Fig lc. However, in the illustrated example of Fig ld, the first rotation unit 180a, if present, is arranged in the flow directly before the second FFT unit 130. In the illustrative example of Fig ld, the second rotation unit 180b, if present, is arranged in the flow directly before the third FFT unit 150.
    In a not illustrated example, the first rotation unit 180a is arranged in the flow directly after the first FFT unit 110 and fed with the data from the first FFT unit 110 while the second 20 rotation unit is arranged in the flow directly before the third FFT unit 150. In another not illustrated example, the first rotation unit 180a is arranged in the flow directly before the second FFT unit 130 while the second rotation unit 180b is arranged in the flow directly after the second FFT unit 130 and fed with the data from the second FFT unit 130.
    In Fig 3, a first 1D Fourier transform determination unit 310 is arranged to determine a first one dimensional Fourier transform unit arranged to receive the cubic three dimensional data set as a one dimensional data blocks related to a first spatial dimension and to perform a Fourier transform for the first spatial dimension based on the respective data blocks. The first Fourier transform unit 310 is in one example arranged to receive blocks row-wise (first spatial 30 dimension), to perform the 1D Fourier transform on the respective received block and to output the results as row-wise blocks. 16 In Fig 4, a first data permutation unit 420 in the form of a 2D transposition unit is arranged to provide the cubic three dimensional data set as one dimensional data blocks related to a second spatial dimension. In the illustrated example, the three dimensional data set is received row-wise and outputted column-wise. The first data permutation unit is arranged to 5 cooperate with a memory 460.
    In one example, the first permutation unit is arranged to manage all the samples of each 2D layer of the 3D data set. In one example it comprises 2D data sets formed by dimensions X and Y. Its complexity is of order N1 x N2, where N1 is the number of samples in the first dimension 10 and N2 the number of samples in the second dimension. Therefore, the memory 460 will take up a large area in general. External memories (not shown) may be used for storing all the samples. Due to real-time constraints, the system may receive a series of 2D data sets one after the other. Accordingly, the first permutation unit 120 may be capable of reading a 2D data set from the memory 160 and, at the same time, store samples of the following 2D data set.
    The access to the memory 460 may be limited. In general, in small memories it is possible to read or write in any memory address. On the contrary, large memories are not so easily addressable. For instance, the access to external SDRAMs is performed by selecting a row and 20 reading or writing samples in the columns of this row. A change in the row leads to an important overhead due to the fact that several commands need to be executed on the SDRAM in order to change the active row, which is needed before new data can be read or written. Therefore, it may not be advisable to write rows of the 2D data set in rows of the memory, since data would eventually have to be read column by column. Thus, this case 25 demands a procedure for reading and writing that can efficiently use the memory 460. In an alternative example, additional hardware is included.
    Thirdly, under certain circumstances several memories 460 are used in parallel instead of a single one. Considering that a memory characteristically achieves a throughput of one sample 30 per clock cycle, a group of memories is used when several data are received in parallel. Indeed, the throughput of a memory can be lower than one sample per clock cycle. This is for 17 example the case of the external memories discussed above, which include overheads due to refresh or to activation of the rows of the memory. In this case, several memories in parallel can be used in order to meet the throughput of the system. Apart from the throughput adjustment, several memories are also used when the size of the 2D data set is larger than 5 that of a single memory.
    Fourthly, the 2D data set to be transposed can be square but also non-square. Further, a design problem can include any combination of the cited difficulties. For example, it could be necessary to design a circuit for the real-time transposition of a non-square 2D data set using 10 several memories with access limitations with several inputs in parallel.
    In Fig 5, a second 1D Fourier transform determination unit 530 is arranged to determine a second one dimensional Fourier transform unit arranged to receive the three dimensional data set as a one dimensional data blocks related to the second spatial dimension and to 15 perform a Fourier transform for the second spatial dimension based on the respective data blocks. The second Fourier transform unit 530 is in one example arranged to receive blocks column-wise (second spatial dimension), to perform the 1D Fourier transform on the respective received block and to output the results as column-wise blocks. 20 In Fig 6, a second permutation unit 640 in the form of a 3D rotation unit is arranged to provide the three dimensional data set as one dimensional data blocks related to a third spatial dimension. In the illustrated example, the three dimensional data set is received column-wise and outputted height-wise. The second data permutation unit 640 is arranged to cooperate with a memory 670. 25 The second permutation unit 640 is arranged to perform a 3D rotation. It is arranged to perform the 3D rotation by storing values in the memory 670 using one mapping and reading them out using another. This is performed by associating a delay to each received sample, wherein each delay is determined so as to reorder the samples to provide the one dimensional data blocks related to the third spatial dimension. 18 The second permutation unit 640 is further arranged to write new values into the locations that have just been read. In this way it saves memory and thereby both area and power consumption. Further, double buffering is avoided.
    The memory 670 can comprise several memories for the same reasons as presented in the 5 description of Fig 4 for memory 460.
    In Fig 7, a third 1D Fourier transform determination unit 750 is arranged to determine a third one dimensional Fourier transform unit 750 arranged to receive the three dimensional data set as a one dimensional data blocks related to the third spatial dimension and to perform a 10 Fourier transform for the third spatial dimension based on the respective data blocks. The third Fourier transform unit 750 is in one example arranged to receive blocks height-wise (third spatial dimension), to perform the 1D Fourier transform on the respective received block and to output the results as height-wise blocks. 15 In Fig 8, a second permutation unit 840 in form of a 3D rotation unit is arranged to receive the 3D data set as one dimensional data blocks related to the second or first spatial dimension, and to associate a delay to each received sample determined so as to reorder the samples to provide the one dimensional data blocks related to the third spatial dimension. Accordingly, a three dimensional rotation of the data set is performed. 20 The second permutation unit 840 in form of a 3D rotation unit comprises a memory 870. The memory is arranged to receive input data in the form of a three dimensional data set. A controller 845 is arranged to control read-out from and writing to the memory 870. In one example, the controller 845 is arranged to control read-out from and writing to the memory 870 so that read-out of a sample from the memory and writing of a received sample is 25 performed to the same memory position in the memory. This will be described in detail below.
    The controller 845 comprises a counter 841 arranged to provide a count signal defining pace of operation of the second permutation unit. In one example, the counter is arranged to provide the count signal at the same pace as samples arrive at the input. In one example (not illustrated) a buffer is arranged to receive and buffer the received samples, or the samples to 30 be sent to subsequent blocks, and guarantee reading or writing of data into the memory at 19 the pace given by the counter 841. The controller 845 is arranged to control writing to and read-out from the memory (170; 870) based on a counter signal from the counter 841. The counter 841 is arranged to count a predetermined number of clock cycles determined based on the number of spatial positions in the three dimensional data set. If the data set is handled 5 in parallel, the predetermined clock cycles is also determined based on the number of parallel inputs. The three dimensional data set can then be associated to an index defined by the counter signal, said counter signal indicating the spatial position in the three dimensional data set of the respective sample. The delay for the respective sample is determined in accordance with said index. 10 The controller 845 comprises further an address mapper unit 842 arranged to receive the counter signal from the counter 841 and to map the received counter signal to an associated memory position in the memory 870 for reading and writing a sample. In one example, the address mapper unit comprises one or a plurality of mapping schemes. Each mapping scheme defines a memory address position associated to each count value (i.e. index in the three 15 dimensional data set). In one example, the mapping schemes comprise logical mapping schemes mapping each bit position in the count signal to a predetermined bit position in the memory address. Thus, the mapping scheme determines the read/write pattern in the memory.
    In one example, the controller 845 comprises further a mapping selector unit 844 arranged to 20 select one mapping scheme from the plurality of mapping schemes based on the counter signal. The controller 845 comprises further a multiplexer 843 arranged to receive the select signal from the mapping selector unit 844 and to control output from the address mapper unit 842 in accordance with the received selection signal.
    In one example, the second permutation unit 840 further comprises an auxiliary permutation 25 unit 846 arranged to re-order samples read out from the memory 870 so as to permute locked index bits in the memory. This may be necessary if the used memory is subjected to constraints in the flexibility in writing/reading data and the needed permutation therefore cannot be fully performed directly on the memory.
    The second permutation unit 840 in form of a 3D rotation unit is arranged to operate as 30 follows. The address mapper unit receives the bits from the counter and permutes them into address mappings. The number of mappings and their design depend on the constraints of the selected memory. The current mapping is determined by the mapping selector which keeps track on the number of frames or sets of 3D data that have been rotated. The mapping selector is arranged to keep track on the same amount of frames as there exists different 5 address mappings. The mapping selector is arranged to circulate among these mappings in accordance with a predetermined selection scheme.
    In Fig 9a, an example input to a second permutation unit in form of a 3D rotation unit which is arranged to receive the three dimensional data set as a one dimensional data blocks related to 10 the second spatial dimension. In Fig 9b the output of a second permutation unit as one dimensional data blocks related to the third spatial dimension given the input in Fig 9a is presented. Accordingly, a three dimensional rotation of the data set is performed by this example of the second permutation unit. 15 The examples illustrated in Figs 9a, 9b are simplified as the set of data comprises 4 samples in each dimension. Thus, each data in the 3D data has a relation in the data set described by two bits in each dimension. Thus, in order to index each sample of the data set, six bits are required. 20 In Fig 10, reading out from and writing to a memory is illustrated when performed on an unconstrained memory. In the illustrated memory, the size of each dimension is 256 and hence the number of bits needed to index all samples is 8x3=24. The memory permutation is executed by writing data in a specific order and then read it in a different order so that the resulting output order is the wanted order. In order to maintain high memory bandwidth and 25 sample throughput, new data is written to the same location as the permuted values are read. Thereby, use of double buffers can be avoided and area and power consumption can be reduced.
    In the illustrated example, the memory receives one dimensional data blocks sorted as 30 described in relation to Figure 9a and outputted as described in relation to Figure 9b. 21 In Fig 11, a memory permutation is illustrated performed on a memory with three bits locked due to access constraints (indexes 10-8). In the illustrated memory the size of each dimension is 256 and hence the number of bits needed to index all samples is 8x3=24. The memory permutation is executed by writing data in a specific order and then reading it in a different 5 order so that the resulting output is in the wanted order, or as close to the wanted order as possible. If it is not possible to achieve the full permutation on the memory, an auxiliary permutation 846 or correction circuit can be fed with the output from the memory. The address mapper is then arranged to provide as good mapping as possible given the constraints of the memory. Thus, some bits are locked in the memory and cannot be permuted by the 10 address mapper. Those bits are permuted by the auxiliary permutation unit.
    The auxiliary permutation unit is then arranged to permute the output samples which are not permuted by the address mapper.
    Figure 12 illustrates an example of a method 200 for performing a three dimensional, 3D, 15 Fourier transform on a three dimensional data set. The method comprises the steps of receiving S10 the three dimensional data set as a one dimensional data blocks related to a first spatial dimension, performing S20 a Fourier transform for the first spatial dimension based on the respective data blocks, providing S30 the three dimensional data set as one dimensional data blocks related to a second spatial dimension, performing S40 a Fourier transform for the 20 second spatial dimension based on the respective data blocks, providing S50 the three dimensional data set as one dimensional data blocks related to a third spatial dimension, and performing S60 a Fourier transform for the third spatial dimension based on the respective data blocks. The step of providing S50 three dimensional data set as one dimensional data blocks related to a third spatial dimension comprises in the illustrated example associating a 25 delay to each received sample according to a permutation scheme, wherein the permutation scheme is determined so as to reorder the samples to provide the one dimensional data blocks related to the third spatial dimension. In a not illustrated example, instead, the step of providing S30 three dimensional data set as one dimensional data blocks related to a second spatial dimension comprises associating a delay to each received sample according to a 30 permutation scheme, wherein the permutation scheme is determined so as to reorder the samples to provide the one dimensional data blocks related to the second spatial dimension. 22 In Figure 13, a step of providing S50 three dimensional data set as one dimensional data blocks related to a third spatial dimension in a method for performing three dimensional, 3D, Fourier transform on a three dimensional data set comprises the following steps: A step of providing S51 a counter signal that counts a number of clock cycles determined by 5 the number of spatial positions in the three dimensional data set, wherein writing to and readout from the memory (170; 870) is controlled based on the counter signal bits. Here Cm„ is the number of total memory accesses in one 3D data set and Nm„ is the total number of mappings. 10 A step of mapping S52 the received counter signal to an associated memory position in the memory for reading and writing a sample.
    A step of controlling S53 read-out from and writing to at least one memory so that read-out of a stored sample and writing of a received sample is performed to the same position in the 15 memory.
    Those steps are repeated until all the input data has been processed. 23
    权利要求:
    Claims (16)
    [1] 1. Device (100) for performing Fourier transform on a three dimensional data set comprising a first one dimensional Fourier transform unit (110) arranged to receive the three dimensional data set as a one dimensional data blocks related to a first spatial dimension and to perform a Fourier transform for the first spatial dimension based on the samples of the respective data blocks related to the first spatial dimension, a first data permutation unit (120) arranged to receive an output from the first one dimensional Fourier transform unit (110) and to provide the three dimensional data set as one dimensional data blocks related to a second spatial dimension, a second one dimension Fourier transform unit (130) arranged to receive the one dimensional data blocks related to the second spatial dimension and to perform a Fourier transform for the second spatial dimension based on the samples of the respective data blocks related to the second spatial dimension, a second data permutation unit (140) arranged to receive an output from the second one dimensional Fourier transform unit (130) and to provide the three dimensional data set as one dimensional data blocks related to a third spatial dimension, and a third one dimension Fourier transform unit (150) arranged to receive the one dimensional data blocks related to the third spatial dimension and to perform a Fourier transform for the third spatial dimension based on the samples of the respective data blocks related to the third spatial dimension, wherein the first or second data permutation unit (140) is arranged to associate a delay to each received sample determined so as to reorder read-out of the samples to provide the one dimensional data blocks related to the second or third spatial dimension.
    [2] 2. Device according to claim 1, wherein the first or second data permutation unit (140) is arranged to reorder the samples so as to perform a three dimensional rotation. 24
    [3] 3. Device according to any of the preceding claims, wherein each sample of the three dimensional data set is associated to an index indicating its spatial position in the three dimensional data set and that the delay for the respective sample is determined in accordance with said index.
    [4] 4. Device according to any of the preceding claims, wherein the first and/or second data permutation unit comprises at least one memory (160, 170; 870).
    [5] 5. Device according to claim 4, wherein the first or second permutation unit (140; 840) further comprises a controller (845) arranged to control read-out from and writing to the at least one memory (170; 870) so that read-out of a sample from the memory and writing of a received sample is performed to the same memory position in the memory.
    [6] 6. Device according to claim 5, wherein the controller (845) further comprises a counter (841) arranged to count a predetermined number of clock cycles determined based on the number of spatial positions in the three dimensional data set and wherein the controller (845) is arranged to control writing to and read-out from the memory (170; 870) based on a counter signal from the counter (841). 20
    [7] 7.Device according to claim 5 or 6, wherein the controller (845) further comprises an address mapper unit (842) arranged to receive the counter signal from the counter (841) and to map the received counter signal to an associated memory position in the memory (170; 870) for reading and writing a sample. 25
    [8] 8.Device according to claim 7, wherein the address mapping unit (842) comprises a plurality of selectable mapping schemes and wherein the controller (845) further comprises a mapping selector unit (844) arranged to select one mapping scheme from the plurality of mapping schemes based on the counter signal and to provide a select signal indicating the selected mapping scheme.
    [9] 9. Device according to claim 8, wherein the controller (845) further comprises a multiplexer (843) arranged to receive the select signal from the mapping selector unit (844) and to control output from the address mapper unit (842) in accordance with the received selection signal.
    [10] 10. Device according to any of the preceding claims, wherein the first or second permutation unit (120; 140; 840) further comprises an auxiliary permutation unit (846) arranged to re-order samples read out from the at least one memory (170; 870) so as to permute locked bits in the memory.
    [11] 11. Device according to any of the preceding claims, wherein the device is arranged to handle parallel inputs.
    [12] 12. A method (200) for performing Fourier transform on a three dimensional data set comprising receiving (S10) the three dimensional data set as one dimensional data blocks related to a first spatial dimension performing (S20) a Fourier transform for the first spatial dimension based on the respective data blocks so as to provide the three dimensional data set Fourier transformed in the first dimension, providing (S30) the three dimensional data set as one dimensional data blocks related to a second spatial dimension, performing (S40) a Fourier transform for the second spatial dimension based on the respective data blocks so as to provide the three dimensional data set Fourier transformed in the first and second dimensions, providing (S50) the three dimensional data set as one dimensional data blocks related to a third spatial dimension , and performing (S60) a Fourier transform for the third spatial dimension based on the respective data blocks so as to provide the three dimensional data set Fourier transformed in the first, second and third dimensions, 26 wherein the step of providing the three dimensional data set as one dimensional data blocks related to a second or third spatial dimension comprises associating a delay to each received sample according to a permutation scheme, wherein the permutation scheme is determined so as to reorder the samples to provide the one dimensional data blocks related to the second or third spatial dimension.
    [13] 13. Method according to claim 12, wherein the step of providing (S30, S50) the three dimensional data set as one dimensional data blocks related to a second or third spatial dimension comprises a step of controlling (S53) read-out from and writing to at least one memory (170; 870) so that read-out of a sample from the memory and writing of a received sample is performed to the same memory position in the memory.
    [14] 14. Method according to claim 13, wherein the step of providing (530, 550) the three dimensional data set as one dimensional data blocks related to a second or third spatial dimension comprises a step of providing (S51) a counter signal counting a predetermined number of clock cycles determined based on the number of spatial positions in the three dimensional data set, wherein writing to and read-out from the memory (170; 870) is controlled based on the counter signal.
    [15] 15. Method according to claim 14, wherein the step of providing (S50) three dimensional data set as one dimensional data blocks related to a second or third spatial dimension comprises a step of mapping (552) the received counter signal to an associated memory position in the memory for reading and writing a sample.
    [16] 16. Software for executing the steps of the method for performing Fourier transform on a three dimensional data set in accordance with any of the claims 12 - 15. 1 ( First 1D FFT unit npu (1 100a 1 ( Third 1D FFT unit 3D rotation unit memory Output 1/6 Fig la 11 ( ( 2DSecond transposition1D FFT unitunit memory 170 160-- 100b Fig lb 1111 Input r r , ( First 1D 3D rotation Second FFT unit unit 1D FFT unit 170 memory 160 1 ( Third 1D FFT unit ( 2D ) transposition unit memory Fig lc100c 110 180a180b 120/11 L_] 160/170170/160 Fig Id 100d (1 Output Input L i 1180a ( (120/1(1 1—) i_ 170/160 140/120 180b 1 Output r 160/170 Output 2/6
    类似技术:
    公开号 | 公开日 | 专利标题
    US9189415B2|2015-11-17|EDRAM refresh in a high performance cache architecture
    US8514651B2|2013-08-20|Sharing access to a memory among clients
    US11099746B2|2021-08-24|Multi-bank memory with one read port and one or more write ports per cycle
    EP3091439B1|2019-12-25|Multi-bank memory with multiple read ports and multiple write ports per cycle
    US10210043B2|2019-02-19|System and method for performing simultaneous read and write operations in a memory
    US8560767B2|2013-10-15|Optimizing EDRAM refresh rates in a high performance cache architecture
    CN102073461B|2012-07-04|Input-output request scheduling method, memory controller and memory array
    US11120329B2|2021-09-14|Multicast network and memory transfer optimizations for neural network hardware acceleration
    US20170364408A1|2017-12-21|Multiple read and write port memory
    EP3289462B1|2019-04-24|Multiple read and write port memory
    US9496009B2|2016-11-15|Memory with bank-conflict-resolution | module including cache
    SE1450880A1|2016-01-10|Device and method for performing a Fourier transform on a three dimensional data set
    US20120042149A1|2012-02-16|Multimode accessible storage facility
    US9195622B1|2015-11-24|Multi-port memory that supports multiple simultaneous write operations
    US7159084B1|2007-01-02|Memory controller
    US6640296B2|2003-10-28|Data processing method and device for parallel stride access
    EP3356945B1|2019-09-04|Computer device provided with processing in memory and narrow access ports
    US10146710B1|2018-12-04|Multiple input multiple output arbiter device
    US20040240755A1|2004-12-02|Method and apparatus data re-arrangement
    CN109445852B|2020-08-25|Method and system for improving memory access efficiency in multi-core processor
    US9442661B2|2016-09-13|Multidimensional storage array and method utilizing an input shifter to allow an entire column or row to be accessed in a single clock cycle
    US11016704B2|2021-05-25|Semiconductor system including various memory devices capable of processing data
    US7457937B1|2008-11-25|Method and system for implementing low overhead memory access in transpose operations
    US11182099B2|2021-11-23|Memory system and operating method thereof
    US10929778B1|2021-02-23|Address interleaving for machine learning
    同族专利:
    公开号 | 公开日
    WO2016007069A1|2016-01-14|
    SE539721C2|2017-11-07|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US5339265A|1992-08-31|1994-08-16|University Of Maryland At College Park|Optimal unified architectures for the real-time computation of time-recursive discrete sinusoidal transforms|
    US7392275B2|1998-03-31|2008-06-24|Intel Corporation|Method and apparatus for performing efficient transformations with horizontal addition and subtraction|
    US6073154A|1998-06-26|2000-06-06|Xilinx, Inc.|Computing multidimensional DFTs in FPGA|
    ES2283236B2|2007-04-12|2008-03-16|Universidad Politecnica De Madrid|PROCEDURE AND ARCHITECTURE WITHOUT MEMORY FOR THE CALCULATION OF FFT ROTATIONS.|
    US8539201B2|2009-11-04|2013-09-17|International Business Machines Corporation|Transposing array data on SIMD multi-core processor architectures|
    US9203671B2|2012-10-10|2015-12-01|Altera Corporation|3D memory based address generator for computationally efficient architectures|WO2018213438A1|2017-05-16|2018-11-22|Jaber Technology Holdings Us Inc.|Apparatus and methods of providing efficient data parallelization for multi-dimensional ffts|
    法律状态:
    优先权:
    申请号 | 申请日 | 专利标题
    SE1450880A|SE539721C2|2014-07-09|2014-07-09|Device and method for performing a Fourier transform on a three dimensional data set|SE1450880A| SE539721C2|2014-07-09|2014-07-09|Device and method for performing a Fourier transform on a three dimensional data set|
    PCT/SE2015/050689| WO2016007069A1|2014-07-09|2015-06-15|Device and method for performing a fourier transform on a three dimensional data set|
    [返回顶部]